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ABSTRACT 


NTSC composite color television signals ate sampled 
at four times the color subcarrier and transformed using 
intraframe two dimensional Walsh functions. We show that by 
properly sampling a composite color signal and employing a 
Walsh transform the YIQ time signals which sum to produce 
the composite color signal can be represented, in the 
transform domain, by three component signals in space. By 
suitably zonal quantizing the transform coefficients the YIQ 
signals can. be processed independently to achieve data 
compression and obtain the same results as com v ..ant coding. 
Computer simulations of three bandwidth compressors 
operating at 1.09, 1.53 and 1.8 bits/sample are presented. 
The above results can also be applied to the PAL color 
system. 
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I Introduction 

The image processing facility at the Communications 
Laboratory of the City Col logo of Now York was used to 
investigate low bit rate, intraframe, video bandwidth 
compression techniques. Both Hadamard transform and 
predictive coding techniques were computer simulated and 
subjectively compared. A predictive coder with a delta 
modulator quantizer was implemented in hardware. 


II. Video Bandwidth Compression Algorithms 


Three algorithms were computer simulated and 
compared. The characteristics of the algorithms are 
sumarized below. A detailed description of the algorithms 
are given in appendix A and B. 

A. Hadamard Transform Coding 


1. The' transform operated on the composite NTSC 
signal sampled at 4 times the color subcarrier frequency 


(14.3 MHz) 


2. The transform was two dimentional, intra 


field, and non-adaptive . 


3. The bandwidth compressed bit rate was chosen 


to be 21.5 MB/sec. 


B. Delta Modulator 


signal . 


1. The input signal was a composite NTSC color 


2. The sampling rate and the transmitted bit rate 





was set at 21,5 MB/sec (6 times the color su&qgrrier 
frequency) . , 

3. The predictor used eight past samples from the 
current scanning line and was adaptive, 

C, Adaptive DPCM 

1. The imput signal was a composite NTSC color 
signal sampled at 10.7 MHz (3 times the color subcarrier 
frequency) . 

2. The predictor used 4 past samples from the 

current scanning line and was adaptive. ^ 

3. The quantizer was adaptive" and generated 2 
bits (4 quantization levels) per sample. 

4. The transmission bit rate was 21.5 MB/sec. 


III. Real Time Video Bandwidth Compressor 


< A real time adaptive delta modulator (ADM) was built 

* ’* 

and subjectively evaluated. The specifications of the ADM 
were given in section II B. A detailed description of the 
algorithm, block ’diagrams and circuit schematic of the coder 
are given in appendix A. 


IV. • Results 


A comparison of the three coding algorithms have 
revealed the following 

1. ’ At low bit rates, less than 21 MB/s, transform 
coding produced the best subjective pictures. 

2. At 21 MB/s the delta modulator (ADM) produced 




3 ) 


the same quality pictures as an adaptive DPCM coder* (See 
appendix A) . 

3. At 21 MB/s the ADM picture quality was 
sufficient for many teleconferencing applications. 



I 


4 ) 


« 

IV. 

Appendix A 
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ABSTRACT 


Predictors operating on video signals sampled at 6 

times the color subcarrier (6fc* c ) have been investigated and 

compared with predictors operating at 3 times the color 

subcarrier (3£ ). When the best 6f predictor is used with 
f * c c 

an adaptive delta modulator (ADM) step size generator, the 
resulting pictures are similar in quality to 3f c predictors 
operating with a four level adaptive DPCM quantizer. 

An ADM coder was implemented in real time. The 
coder used between 24 and 34 IC's, depending upon the 
algorithm, and fits on a single 9"x6 w PC board. The 
transmission rate is 21.4 Mb/s. Subjective evaluation of 
the coder revealed that the picture quality was sufficient 
for many teleconferencing applications. 


COMPOSITE NTSC COLOR VIDEO BANDWIDTH COMPRESSOR 



I. Introduction 
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The research presented in- this paper was motivated 
by the need to design a simple, low cost, digital, video 
bandwidth compressor that would produce teleconferencing 
quality pictures,- The bit rate was set at 21.4MB/s to allow 
two TV signals to be sent over a single T3 telephone line 
or 36 MHz satellite link. 

Most of the recent literature on video bandwidth 
compression has been concerned with the design of very 
complex encoders whose implementation requires a rack of 
equipment. In this paper we present a video bandwidth 
compressor that was constructed .from the standard 100K 
series ECL IC’s and fits on a 9 x 6 PC board. 

The need to keep the coder simple and low cost 
precluded the use of any compression technique other than 
intraframe predictive coding. A choice between composite or 
component coding, and a choice between one or two 
dimentional prediction remains. Since most video sources 
are in composite form, the extra circuitry n eeded to 
generate the components from a composite source mediated in 
favor of a composite coder. A two dimentional predictor 
requires at least one scanning line of memory and it also 
requires that the sampling clock of the coder be synchonized 
to the horizontal sync; i. »'0 T to the burst. Neither is 
needed for one dimensional prediction. Complexity was the 
deciding factor, and one dimentional prediction was chosen. 
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| ' Two schemes were considered for implementation in 

hardware. One was a DPCM 'coxier that used an adaptive 

i J 7 'J 

1 4 • * • 

jM /. quantizer (ADPCM) . The ADPCM coder would sample the video 



/ signal at 10,7 MHz (3f ) and transmit 2 bits per sample. 

w 

» 

V The other scheme was an adaptive delta modulator (ADM). The 
* 

!♦ ADM would sample the signal at 21,4 MHz (fi f ) and transmit 
* * 

1 bit per sample. Both schemes would transmit at the same 

» * 

rate, 21.4 MB/s. 

% 

• i 

• The ADM uses a predictor for which the composite 

0 

video signal is sampled at 6 f_. To the best of the 

V 

*’ authors’ knowledge no prior work «>as been done on predictors 

7* at a sampling rate of 6 fc. 

• 

Fig. la is a block diagram of the adaptive delta 

* * * 

modulator (ADM) and Fig. lb is a block diagram of the 
adaptive DPCM coder (ADPCM). The symbols used in Fig. 1 are 

used throughout the rest of the paper. 

. * * 

% ♦ 

t 

M 

•’ II. ADM Predictor (6 x coldr subcarrier) 

I 

' This section presents the derivation of the 

predictors which use a composite video signal sampled at 6 
times the color subcarrier (6f ) . Fig. 2 shows the location 

♦ 

of the samples in the picture with respect to the color 
V. subcarrier. Fig. 2 was drawn for constant luminance and ^ 



chrominance. X is the pel to be predicted. P is the 
* predictor's estimate of X. P is formed from a weighted sum 
4 of past pels as shown in Eq. 1 and Fig. 1 

.* P a cSA + bB + cC 4- eE 4- fF 4- gG 4- BH 4*.... (1) 



where ; 
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A,B f C..,are the inputs to ’bhe. predictor 

>h r * 

a,b,c,..are the prediction coefficients for pels A,B,C.* 


»» 


A predictor that sets P equal to sample X, (see Fig. 
2) is a 'reasonable predictor. The values of the prediction 
coefficents that set P » X in Eq . 1 for th*e conditions of 
Fig. 2 can be found as follows: Let the luminance of all 

the pels equal a , let the phase angle of the subcarrier be 0 
with respect to the sampling clock, and let the amplitude of 
the subcarrier be P , then the pels X and A through H are- 
given by: 

X - ot f 3 cos 0 

A « a + 3 cos ( 0 + 300) = a + .5 3 C0S ®* .5 /T"° 3sin 0 

B = a -.5 pcos 8 + .5 ST 3sin0 

C * a - 3 cos 0 

D » a - . 5 3 co s 0 - .5 /T" 3 s i n 0 

E oi a +.5 3. cos 0 - .5 /T" ,3 sin 0 

F ■* a + 3cos 0 

* 

G « A 


H - B 


Substituting the values of the pels A through H into Eq. 1 f 
7 and setting P = X yields: 


mm 


3 


ISMS* 





!* 


! 



if 


I 


i 




II 

E»# 



s 


f 


• . 


, * 


,r 









n 

'ta * 
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P * X =* a + 0 cos 0 * a { a + « 5 0 cos 6 + .5 /3 0 sin O ) + 

» 

b ( a -. 5 0 cos 0 + ,5 /3$ sin 0 ) + c ( a * 0 cos 0 ) + 

V 

d ( a 5 0 cos 0 5 * /3- 0 sin 0 ) + 
e ( a + . 5 0 cos 0 5 /3 0 sin 0 ) + 
f ( af p cos 0 ) +g ( a + .50cos0 + .5 /? 0 sin 0 ) + 
h ( a -.5 0 cos 0+ .5 /3 0 sin 0 ) 

If the left side of Eq t is to equal the right side for all 
values of a, 0 and 0 three conditions must be met: 1) The 
sum. of all terms containing a on the right side of Eq. 2 
must sum to a; 2) The sum of all terms containing sin 6 must' 
sum to zero; and 3) The sum of all terms containing 0 cos 
must sum to 0 cos 0 . These three conditions give rise to 

equations 4 and 5: 

a + o + c + d + e + f + g + h“' 1 (3) 

a + b + 0- d- e + 0 + g + h = 0 (4) 

J 

a - b - 2c>~ d + e + 2f+ g - h - 2 (5) 

Since there are only three equations and many 
unknowns there are an infinite number of solutions to Eqs. 3 
- 5. Several solutions are listed below with the values for 
a, b , c... substituted back into Eq. 1. 



fc 


I. 

II. 


n • 

' '» 
i 


• hi. 

IV. 


P » 2A - 2B + C 
P = 1 . 5A - B + . 5D 
P « A + D - C 
P = A - .25B + . 5E - .25H’ 

P - A - • 25B - . 5C -t . 5D + .25E 
4 * 


( 2 ) 


e 


/ 

f 


•'! 

. * * 
• I T 

• * 

» 


P « . 65A + . 05B - ,4C + • 0 5D + .F5E 


VII. 


P ® P 


* * * 
t* m*. 

ft* 
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, ’ • 
"* > 


i . \ - 

4 . .. 


f ■ f. > 

| t I .* • 

I v;’ ; - ■' 

"I " !i rK‘? •< 

; V.;- •• 

4? •*/ 


The predictors listed abw/e are referred to as subcarrier 
predictors because they were derived so as to predict the 
values of the samples along a constant subcarrier. 

The following comments can be ma.de regarding the 
predictors. Predictor I uses the most recent pels,, and 
therefore, it should be ab3 e to respond well to sudden 
changes in the picture. For predictor VI the sum of the 
squared values of the prediction coefficients are equal to 
1, which is less than all other predictors except predictor 
VII. Small prediction coefficients are important since the 
quant i za t i on • no i se in the encoded pels A, B r C.... is 
multiplied by their respective coefficients. If the 
quantization noise of each encoded pel is independent and of 
equal variance, then the quantization noise in P will be 
proportional to the sum of the squared values of the 

i 

prediction coefficients. . * 

Subcarrier predictors produce prediction errors 
during and shortly after si ep changes in luminance. To 
minimize this problem we introduced the edge predictor, 
predictor VIII, shown below: 


VI I x P - A 


:• /»' ’ *. 

-4 V 9 

-V f V* 

¥ ;•/ , 

♦ #t\ V * 


* w **• 
9. , 

V,\V ’ .* 


The hypothesis behind predictor VIII is that the .. 
previously estimated sample is a better predictor than a 
subcarrier predictor when there i.s a sudden change in 
luminance. 


5 
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The edge predictor can be combined with any 
subcarrier predictor by introducing the parameter N. Eq . 6 
thru 8 show the resulting predictor. When N=1 Eq. 8 reduces 

•ITS 

to the subcarrier pred ic tor ‘.and when N=0 Eq. 8 reduces to 
the edge predictor. 

P = (1-N) (EDGE PREDICTOR) + N (SUBCARRIER PREDICTOR); 0<N<1 

i-m 

P = (1-N) A + N(aA + bB + cC +..,.) ? 0 <N <1 
P * (1+N (a-1) ) A + N(b B + c C +...); 0 <N <1 

t 

Eq. 6 - 8 are equivalent. The value assigned to N is 
discussed in sections IV and VII. 

III. ADPCM Predictor (3 x color subcarrier) 

A similar analysis to the one presented for the 6f c 
(ADM) predictor can be carried out for the ADPCM predictor. 
Since the ADPCM coder samples at 3f , only samples B r D, F 

G 

and H are available. (See Fig. 2). Eqs. 3-5 yield only 
one solution and it has the form: 

P - F + (B-H)A ; A can be any number 

The value of A that minimized the mean square prediction 
error for the test pictures in Fig. 3 is 0.8. This results 
in predictor IX. 

IX P = . 8B + F - . 8H 

The terms in predictor IX. have the following 
interpretation. Sample F is a perfect predictor for X when 


the luminance and chrominance remain constant. When the 
luminance changes, the term (B-H>(.8) adds a slope 

correction factor to F. , . 
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IV. Predictor Performance Results 

The predictors were evaluated using the test 
pictures shown in Fig. 3. The evaluation was carried out 
without a quantizer. The performance criteria is a 
normalized predictor gain [2] which is defined as the ratio 
of the peak-to-peak signal power to the mean square error 
signal. Mathematically the performance criteria has the 
form of a signal-to-noise ratio and is given by; 


i 


PRED. GAIN 


10 LOG 



p i> 2 

i=l 


S = the peak-to^peak signal amplitude and is 

r r 

equal to 256. 

LL * 

= the i c picture sample 

P. = the prediction of sample Xj (See equation 1) 
M = the number of samples in the picture , 


(9) 


t 


/ 

The larger the PRED GAIN the better the predictor e 

The results from testing the predictors without a 
quantizer are shown in TABLE I. TABLE 1 shows the PRED GAIN i . 
when the optimum value of N is used in Eq. 8 with predictors • 

* I thru VI. An attempt was made to. increase the diction 
gain over that obtained from the .optimum value of N by 


m 


n 




mm 




TABLE I — Predictor Evaluation Without a Quantizer 


III 

N=. 9 

IV 

N=. 85 

V 

Lf\ 

00 

. 

II 

VI 

N=.75 

vii 

Not Applicable 

VIII 

Not Applicable 

IX 

Not Applicable 

PifB 

Not Applicable 


35.8 

34.8 
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31.5 

32.5 \ 

30.9 ‘ 'i. 

t * » 

24.4 . 

27.8 

28.3 . 

23.0 • 


PREDICTOR 


OPTIMUM.. N*.* 


N«. 9 
N=. 9 


PRED. GAIN** 




i> ! - 


* The relationship between N and the predictor is shown in 
equations 6,7 and 8 


** PRED. GAIN is defined in equation 9 



* '/ 




making N variable. N was set to be a mono ton i c a 1 1 y 
decreasing function of |A - G|. The hypothesis is that the 
value of | A - G | is an indication of an edge. When I A — G | 

4 * it; i 

*• is large N should be small so that Eq. 6 gives more weight 
to the edge predictor, and when | A — G | is small more weight 
’• is given to the subcarrier predictor. With a variable N the 
.* prediction gain increased by only .ldb to Idb (depending 
‘ upon the predictor) over the best fixed N. 

The ADM predictors that relied on the most recent 

i * 

pels did. the best. Unfortunately these predictors also had 

* 

the largest prediction coefficients and as a result they did 

•- 

c 

.• not do the best when a quantizer was added. 
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The quantizer for the ADPCM coder is adaptive [ 31 • 
The way in which the quantization levels adapt is shown in 
Pig. 4. At each sampling instant, k, the quantizer has one 
'/• of four values to choose from, such that 

-q 2 (k) < -q-^k) < q x (k) <q 2 0O 


\ 





i The quantizer will choose the value of q(k) that minimizes 

* v | x k+l ” X k+ll* < l uan Lizer chooses either of the outer / 

7 values, ± q 2 (k), at time k then at time k+1 the quantizer 

. „ will have a larger set of values to choose from such that 

• 

‘ q 2 (k+1 ) > q 2 (k) and q^ (k+1 ) > q ^ (k) . If the quantizer chooses •* 
\ either inner value, lq^ (k) , at time k, then at time k+1 the 
* t quantizer will have a smaller set of, values to choose from 
f such that q 2 (k + l)<q 2 (k) and q 1 (k + l)<q 1 (k). The 



rnmmmmmmmmmrn 


i 




quantizer values are given by the following expressions: 


lq 2 (k) I * E Iqj (k) ! 


|q 2 (k+l)| = P I q 2 ( k ) I “1 If the q uant iz er chose 

{q 1 (k+l)| = P|q 1 (k)| J - q 2 (k) at tirne k * 


lq 2 (k + l)l > Q!q 2 (k)l •) „ the 

quantizer chose 

Iq^k+DI « Q I q (k) I J iq l (k) at tirne k ' 
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E , P and Q were optimized for the pictures shown in Fig. 4 
for a sampling rate of 10.7 MHz (3f c ). 


£ = 3.5 
P = 2.6 
Q = 0. 9 
q^min) = 2 
q 2 (max) = 31 


The quantizer transmits 2 bits to the receiver for 
each picture sample. The first bit, e^, carries the sign of 
,q(k) and second bit, e 2 , signals the generation of q^k) 
or q 2 (k). 

VI. * ADM Quantizer 

The quantizer for the ADM coder is the ADM step size 
generator described by Song [ 4 ]. It is sometimes referred 
to as a P, Q delta modulator because, the step size Increases 
by the factor P or decreases by the factor Q. The ADM coder 


xuy 


can be described by Eq. 10 - 14. 

I 


P K = 2 a i x k-i 

» til 

? hj. is the i prediction 

<10) 

1:0 

coefficient 

’ 


E k+l “ Sign ‘ X k+l~ 

<V B - 1 B k lY k-x»» 

<U) 

y k = lY k ^ia.nE k 

+ * 29 E k-1* 

< 12) 

Y k(min) 88 2 1 

Y k( ma x) - 31 > 


(13) 
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(14) 


where the above variables are defined in Fig. lb. 


I, 

d; 

ni ; 


0 


When E k = E k _^ in Eq. 12 r the step size Y k , increases by the 
factor P = 1.4 and when E k = E k~l f Y k decreases by the 
factor Q = .84. The constants in Eqs. 10-14 were optimised 
for the pictures shown in Fig. 3 for a sampling rate of 21.4 
MHz ( 6 f ) . 

w 

VII. Results of ADM and ADRCM Coding 

This section gives the results of the evaluation of 
the predictors with quantizers. The performance criteria is 
a signal to noise ratio which is defined as the ratio of the 
peak to peak signal power to the filtered mean square error / 
signal. The error signal (defined as , '?« , , ) is 

filtered to eliminate the energy from out of band frequency 
components. These components stretch from 4.2 MHz to one .. 

I 

half the sampling rate. The filters used to eliminate the 
out of band frequency components from the error signal were 
5 pole butterworth filters with a cutoff frequency of 4,2 


MHz. IE the filtered error signal is denoted as EF, then 
the performance criteria is given by; 


S/N 


= 10 LOG 



M 


n Z‘"> 2 
—n 
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(15) 


t 


*** ‘ 


where (EF) 1 is the i*"* 1 filtered error signal. M and Sp p are 
defined for Eq.9. 

The results of ADM and ADPCM coding for the various 
predictors are given in Table II, A comparison of the 
predictors for fi-f sampling with and without the ADM 
quantizer reveals that the ADM quantizer has a significant 
effect on relative predictor performance. Table I shows 
predictor I to be the best predictor, but Table 11 reveals 
it. to be among the worst predictors when a quantizer is 
added. This is probably due to its large prediction 
.’.coefficients. Predictor VI is among the worst predictors in 
Table I (probably because of the small prediction 
coefficients of pel A) but it is among the best in Table II 
(probably because the sum of the squared values of the 
prediction coefficients are very small). The best predictor 
with an ADM quantizer is predictor IV. The reason for this t 
is uncertain but it is probably due to the following ^ } 

factors: The coefficents are small; the most recent pel. A, 

'.is weighted more than any other pel, and it behaves well on 
slopes. If pels A thru H lie on a straight line of 
arbitrary slope then P will equal pel A for predictor IV. 

A subjective comparison between the ADM quantizer i 

■ t * 

m ftmu 


TABLE IX - Predictor Evaluation With A Quantizer 


PREDICTOR QUANTIZER 
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N*=:.73 

N=1 

N*=.62 

N-1 

N*=.58 

N.A. 


S/N from Eq, 15 


VIII 


N.A. 


ADPCM 


N.A. 


ADPCM 


N.A. 


ADPCM 


N.A. 


*' * Optimum value for N 


■ V 1 ' 


f ^ : 


13 


■ 19 ; 


j with predictor XV and the ADPCM quantizer with predictor XX 

% was carried out using the picture processing facilities at 
[ • , The City College of New Yorki, This facility enabled us to 

* * M •*. 

* ’ . 'J 9 * 

r *• computer simulate the ADM and the ADPCM coders for the still 

f »* , 

. pictures in Fig. 3 and then display the results on a SONY 

* » 

» , 

| ,'• TRINITRON RECEIVER /MONITOR. Both coders produced the same 

quality pictures and both exhibited the same type of 

j ,! 

[ ] ' * degradation. The degradation exhibited by the coders was 

* ♦ 

r edge busyness. There was no loss of resolution and little 

I ' * •: 

'* ••'.graininess except in very highly saturated colors. Contour 

I noise was never visable, even for Y = 6. Apparently the 

. min 1 J 

subcarrier acts as an effective dither signal which breaks 


up any contour noise. 


VIII Real Time ADM Coder 
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A real time ADM coder was built and subjectively 
. evaluated. The ADM coder was chosen over the ADPCM coder 
/•because it required fewer IC's to implement. If predictor 
•.IV was implemented with N = 1 the ADM coder could be 

% 

'constructed with 22 IC's from the ECL 100K series, plus a 
D/A converter and a comparator. An A/D converter is not 
! required. If N was set equal to .75 the IC count would 
.‘increases from 24 (D/A and comparator included) to 26. If 
"l the coder was made programmable so that any value of N could 
be chosen between 0 and 1 in increments if 1/8 the IC count 

* 

-would increase to 29, and if N was made equal to a function 
* of | A — G | the IC count would increase to 34. The latter 
coder was built and subjectively evaluated. A block diagram 
.••of the coder is shown in Fig. 5. The functional relationship 


between N and jA-G| is stored in ROM IT.* therefore, by 
plugging in different ROMs we could change N. The P and Q 
values of the step size generator (Eq. 12) were programmed 

* ** » { ti 

V 

into ROM I. By moving jumper wires we could implement 
predictors III, IV or V. This large degree of 
programmability enabled us to check the validity of the 
computer simulations against a real time coder operating on 
motion pictures. 

The real time subjective evaluations produced no 
suprises.- They tended to confirm the results shown in TABLE 
XI. The entries with the highest signal~to-noise ratios 
produced the best pictures. When P ~ 1.4 and Q = .8, N = 
3/4 produced slightly better pictures than N =1 for 
predictor IV. In general, when N was set equal to 1 the 
picture quality was very sensitive to changes in P, Q and 
the predictor. When P was increased from 1.4 to 1.5 and Q 
was reduced from .8 to .5, the picture qua 1 i ty' decreased 
considerably. This was not the case for N = 3/4. Making N 

l i 

a function of ) A— G I did not. noticeably Improve the picture 
when compared with N = 3/4. • 
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IX Real Time Subjective Evaluation of the ADM Coder 


The ADM c^der was programmed with PRED IV, N«.75, 
. P«1.4, Q=. 8 and subjectively eva-lUated. , Evaluation was 
• performed by a group of viewers seated at a distance of f> 

t 

feet from a 19" monitor. The viewers watched several 
■** minutes of a daytime soap opera encoded with the ADM. The 
viewers evaluated the picture by.choosing one of the 
following responses: 


1) The picture appears normal, just like a TV picture 


should appear. 

# 

2) The picture appears degraded from a normal TV but the 

y ' 

degradation is not annoying. 

3) Same as ( 2 ) but the degradation is annoying. 


Untrained viewers usually chose 1 or 2. The authors 
chose 2. After seeing the original and encoded pictures 
side by side most viewers chose option 2. A few chose 
option 3,' 
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X Conclusions 


It is possible to build a digital color TV bandwidth 
compressor, with a transmission rate of 21.4 Mb/s, out of 26 
standard IC's and produce usable quality prictures. The 
simplicity of the design was acheived by using an ADM step 
size generator and a novel predictor designed to operate 
with a sampling rate of 6 times the color subcarrier. 

The ADM coder was compared with a DPCM coder which 
also transmitted at 21.4Mb/s. Both coders produced similar 
quality pictures but the ADM coder required fewer IC's to 
implement. 
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CODE $ 
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Sampling Rate 
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10.7MHz 
Sampling Rate 
( ATPCM) 


Fig. 2 The figure above shows the location of the 
pels with respect to the subcarrier. 


Fig. 3 Test pictures used for evaluation 




Quantizer levels at- time 
k+1 if S K <[q 1 (k) + q 2 (k)]/2 
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Quantizer levels at time k+1 
if €k 


Fig 4 Adaptive quantizer: The quantization levels expand or 
compress for each picture sample as shown. 



♦ 4 


Pig. 5 Block Diagram of the ADM Coder 
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WALSH TRANSFORM CODING OF NTSC COMPOSITE COLOR SIGNALS 
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City College of New York 
Department of Electrical Engineering 
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ABSTRACT j 

NTSC composite color television 
signals are sampled at four times the { 
color subcarrier and transformed using 
intraframe two dimensional Walsh [ 

functions. We show that by properly 
sampling a composite color signal and 
employing a Walsh transform the YIQ time [ 

signals which sum to produce the j 

composite color signal can be 
represented, in the transform domain, by 
three component signals in space. By 
suitably zonal qunatizing the transform 
coefficients the YIQ signals can be 
processed independently to achieve data 
compression and obtain the same results 
as component coding. Computer 
simulations of three bandwith compressors 
operating at 1.09, 1.53 and l.P 

bits/sample are presented. The above 
results can also be applied to the PAL 
color system. 


INTRODUCTION 

The video images used in this 
paper were obtained by the system shown 
in fig.l. The NTSC composite video 
signals is sampled at four times the 
color subcarrier and uniformly quantized 
to 8 bits/sample and stored in the frame 
freeze unit. The frame freeze can store 
two frames, each frame consisting of 512 
samples/line and 512 lines/frame field 
interlaced. The computer interface 
allows images to be transferred between 
the computer and the frame freeze. 

Fig. 2 shows the block diagram of 
the computer simulated system. The frame 
of video is partitioned into 16x16 sample 
data matrix upon which the two 
dimensional Walsh transform operates. In 
general, let the array f(i,j) represent 
the samples of an-NTSC composite image 
over an array of points. Then the two 
dimensional Walsh transform, F(u,v), of 
f(i,j) is given by the matrix product 

rF(u,v)l * 1 H (u ,v) 1 T f ( i , j ) 1 fH (u , v) 1 


where [H(u,v)l is the Hadamard matrix 
consisting of Walsh functions of order N» 
The inverse transformation is defined as 

ff(i,j)l - rH(u,v)HF(u,v)] fH(u,v)l 

The result of the Walsh transform 
is a 16x16 coefficient matrix where each 
coefficient represents the projection of 
the data matrix onto a particular Walsh 
pattern. Data compression ifhandwidth 
compression) can be achieved because the 
image energy which is usually uniformly 
distrubuted in the spatial domain, tends 
to be cone ntrated in those transform 
coefficients which represent the lower 
frequency component of the Walsh domain. 
The majority of the other transform 
coefficients are always nearly zero and 
need not be transmitted. 

The transform coefficients can be 
partitioned as follows; 

1) Luminance information coefficients: 
These coefficient constitute the majority 
of the entries in the coefficient matrix 
and are generally clustered about the low 
frequency components. 

2) The I color signal coefficients; 
These coefficients always appear in a fix 
location in the coefficient matrix when 
the composite signal is properly sampled. 

3) The Q color signal coefficients: 
These coefficients always appear in a fix 
location in the coefficient matrix when 
the composite signal is properly sampled. 

Typical' 1.6x16 coefficient matrixs 
are shown in fig. 3. The signals 
described in statements (2) and (3) above 
can also represent the UV color signals 
in the PAL system. Which signals are 
represented in (2) and (3) above will 
depend on the sampling relative t.o the 
color subcarrier. 

Thus, the Walsh transform not 
only maps the time signals into Walsh 
spectrum signals and compacts the enpray 
distribution, hut also acts like a comb 
filter which seperates the TYO components 
of the composite NTSC signals and maps 
them into specific locations of tb" 
coefficient matrix. Note that the Walsh 
transform can also be used as a color 
detector since the coefficient which 


I 


represents the color information 
represents the intensity of the baseband 
color signal . 

The process of zonal quantizing 
the coefficient matrix consists of. first 
selecting the coefficients to be 
transmitted and then quantizing the 
coefficients prior to transmission. The 
coefficient selection depends on the 
statistical distribution of the energy in 
the coefficient matritt. The larger the 
percentage of the oerqy contained in the 
transmitted coef f ii'ients , the better the 
quality of the reconstructed image. The 
percentage of the energy lost due to 
those coefficients not selected for 
transmission is equivalent to the mean 
square error. Thus, the selection of the 
coefficients to be transmitted is 
basically the task of transmitting as 
much energy as possible in a given bit 
rate. The quantizer performs both 
uniform and nonuniform quantization for 
the coefficients which represent the 
lower frequency components and those 
coefficients which represent the higher 
frequency components respectively. The 
nonuniform characteristics resemble the 
Laplace distribution. This results in a 
trade off between bit rate reduction and 
reduction in quantization error. 


THE WALSH SPECTUH OF I,Q SIGNALS IN 
THE" NTSC COLOR SYSTEM 

In the NTSC color system, 

I - 0. 596R'-0.275G'-0. 321B' 

Q * 0.212R ' -0.523G '+0. 31 IB ' 


where: 


1,0 = the baseband color differential 
signals 

R ’ ,G ' ,B ' * the tristimulate values gamma 
corrected signals 

A NTSC composite color signal is 
given by: 

S = Y+I • cos ( 2 IT f sc +33)+Q*sin(27I f sc +33) 
where: 


S = the NTSC composite color signal 
Y = the luminunce signal, 
f = 3.579545 MHz = (227+1/2) f. 

*> color subcarrier, 
f^ = the horizontal line frequency. 

There are two points that one 
should note. Firstly, the color signals 
appear as amplitude modulated waveforms 
where the amplitudes of the modulated 
waveform are the baseband color 
differential signal. Secondly, the phase 
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of the modulated waveforms always change 
180 from line to line, When th.e 
sampling frequency is equal to four times 
the color subcarrier and the sampling 
occurs at 12, 102, 192, and 2R2 degrees 
of the subcarrier, the sampled modulated 
I and 0 signals will be as shown in 
fig. 4. Thus, if we consider a 16x16 data 
matrix in the two dimensional space, the 
patterns of the modulated signals, I and 
Q, will b.e the same as the patterns of 
the two dimensional Walsh functions 

(16,9) and (16,8) respectively. Tn other 
words, the carrier of the I and Q color 
information are the same as the two 
dimensional Walsh functions (16,9) and 

(16.8) . The result is that amplitudes of 
the modulated I and 0 signals will be 
equal to the values of the coefficients 

(16.9) and (16,8) in the Walsh domain. 
If any other data matrix size such as 
8x8, 4x4, etc were used, the ampliude of 
the I and Q signals will also have 
corresponding coefficients. Just as the 
modulated I and Q siqnals have their 
respective bandwldths in the Fourier 
domain, the will also have their 
respective bandwldths in the Walsh 
domain. The result is that there are 
coefficients in the Walsh domain which 
represent the higher components of the I 
and Q signals as shown in fig. 3. The 
luminance signal, on the other hand, will 
in gereral not be mapped onto the Walsh 
patterns (16,8) and (16,9) and thus will 
not be mapped onto the coefficients in 
the Walsh domain which correspond to the 
I and 0 signals. This is similiar to 
what occurs in the Fourier domain where 
the liminance signal in general does not 
occupy the same frequency’ spectrum of the 
color- signals. Thus, the I and Q 
components of an NTSC composite siqnal 
will be mapped onto certain coefficients 
in the Walsh Coefficients matrix which 
represents the spectrum of these signals. 

If the baseband I and 0 signals 
are seperately sampled at f /4 and 
transformed using two dimensional Walsh 
functions, the energy of the I and 0 
signals will be compacted into 
coefficient (1,1) and neighboring 
coefficients. The coefficients obtained 
in this manner and those obtained by 
transforming the NTSC composite siqnals 
would be identical . If we transform the 
baseband signals, for example, the 
coefficients (1,1), (1,2) and (2,1) which 
are obtained by transforming the T siqnal 
will be equal to coefficients (16,91, 

(16.10) and (15,9' respectively as shown 
in fig. 3. If an Sx 0 Walsh transform is 
performed on the composite siqnal the 
corresspon^ ing T components will be 
(8,5) , ('V , < n ,S) respectively. 

A vector diaqran is shown in 
fig. 5. Each color lias a prescribed 
position in the vector diagram. The Q, T 
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and U, V represent two different 
coordinate systems. The NTRC system uses 
the. 01 coordinates whereas the PAL system 
uses the Uv coordinates. Every color can 
be represented by its prolections along 
the axis of either of these two 
coordinate systems or along any other 
suitable defined set of axis. With 
reference to fig. 5, if. the sampling is 
started at point 1 and continued at 3 
and 4 then the coefficients (16,8),... 
and (16,9).... will be equal to the 
components of Q and I as stated above. 
This means that by sampling at this phase 
relative to the color subcarrier that the 
basis vectors (16,8) and (16,9) will 
correspond to the sampled 0 and I 
chrominace signals respectively i.e. the 
Q signal will be in phase with the vector 

(16.8) and the I siqnal will be in phase 
with the vector (16,9). Note that phase 
shifts of'90 degress will shill produce 
similar results. In general, the color 
signal is time varying so that the 
coefficients (16,8) and (16,9) actually 
represent the average value of the 0 and 
I signals taken over an area equal to the 
transform block size. The coefficients 

(16.7) , (15,8),... and (16,10), 

(15.9) ,.,. represent the higher frequency 
components of the Q and I signals 
respectively. The sum of the vectors 

(16.8) , (16,7), (15,8),.. is equal to the 
Q signal just as the sum of the vectors 

(16.9) , (16,10), (15,9),.. is equal to 
the I signal. The sum of all the vectors 
in the Walsh domain is equal to the NTSC 
composite signal. 

If the sampling phase relative to 
the color subcarrier deviates from the 
above, the basis vectors (16,8) and 

(16.9) will no longer correspond to the 
vectors of the the chrominance signals. 
The result would be that the coefficients 

(16,8) and (16,9) would now contain 
components of both the 0 and I signals. 
Thus, if the Q and I s s are not to 
be seperated then the sampiijjg phase is 
unimportant. However, the amount of 
compression is identical in both cases. 

To show that the above analysis 
is correct the NTSC color bars signal was 
sampled and transformed as described 
above. The result of this transformation 
is shown in Table 1. The slight 
variation of the 0 and X signals form the 
ideal values is due to the sampling phase 
not being exactly as shown in figs. 4 and 
5. However, the results do show that the 
vectors (16,8) and (16,9) correspond to 
the Q and I signals. 

For the PAL color system the 
color subcarrier is at a hiqher frequency 
than in NTSC and the chrominance sionni 
are- not phase shifted by 33 deg»- 
relative to the color subcarrier a- in 
the NTSC system. Consequently, for 
signals in the PAL system the sampling 
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phase relative to the color aubnarrier, 
required to seperate the chrominance 
signals in the Walsh domain, should be 
displaced by 33 degrees relative to the 
NTSC system, i.e, for the PAL system, 
sampling should begin at point J’. 


STATISTICAL PROPERTIES OF COEFFICIENTS 
. IN THE WALSH DOMAIN 


In order to assign bits to each 
coefficient in the transform domain and 
choose quantization characteristics for 
each coefficient, the energy distribution 
in the coefficient matrix and the 
probability density of each coefficient 
were considered. The energy density 
distribution in the Walsh domain is 
• defined as: 


ED (i , j) * 


I 2 v 

m=l n*l 


(i,j) 


B B W W 

2 2 2 2 v »" 

m=l n*l i =1 j*l 


(i,H 


where : 


ED(i,j) a energy density of coefficient 
(i,j). This is averaged over 
the entire image. 

V ( i , j ) = the value of coefficient (i,i). 
(i,j) » the elements In the coefficient 
mstr ix. 

W * the size of the matrix used. 

the total number of m*tlx in the 
partioned image. 

The average value of each 
coefficient is given by: 


av ‘?2 

a m=l. n=l 

and the coefficient variance is given by: 


B B 

VA(i,j)‘ = V V 
tn=l n=l 


rv m n n,i)-Av(i ,1)1 
mn 


The statistical results obtained 
from various different tynes of imeoes 
indicate that the picture energy is 
compacted into those coefficients which 
represent the lower frequency components 
such as coefficients 

and those coefficients which represent 
the color information such as 
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coefficients (16, A) and (16,9), as shown 
in fiq.fi. In fig.fif the darker areas in 
the figure represent the greater energy 
density. Also, the coefficients which 
contain the same energy form hyperbolas 
in the coefficient matrix. The energy 
density of the SMPTE »1 test slide is 
shown in fig. 7. 

The averag.e values of 
coefficients (1,1), ( 1 fi , 8 ) and (lfi,9) 
represent the average intensity of 
luminence, 0 and I siqnals respectively. 
The other coefficients have nearly zero 
average value. The coefficients (1,1), 
(16,8) and (16,9) also have the greatest 
change in variance whereas the other 
coefficients have much smaller changes in 
variance. 

The energy density distribution 
Is ope of the basic factors used to 
s»lv‘! , cfc**tho«e -coefficients which are to -be 
transmitted. Those coefficients which 
contain zero or almost zero energy 
density are not transmitted. In order to 
obtain the optimal bit assignment, the 
number of bits assigned to each 
coefficients is proportional to its 
variance. In this paper, the number of 
bits assigned to each coefficient were 
calculated by the equations 

B ( i , j ) = log 2 f |AV(i,j) I + I'VaVoH + 1 

The B(i,j) matrix for various images 
indicate that coefficients (1,1) requires 
9 bits' allocated, which is the largest 
bit allocation. Approximately half the 
coefficients in the B(i,j) matrix require 
less than 3 bits. Those coefficients 
which contain less than 0. 001/100 
relative energy density are not 
transmitted. The statistical results 
also indicate that those coefficients 
which have the same bits allocation form 
hyperbolas in the B(i,j) matrix. 

Statistical results also indicate 
that for most imaqes coefficients (1,1) 
has an almost liner probability 
distribution, as shown if fig. 8. 
Coefficients (16.8) and (16,9), in 
general, have a Lv place probability 
density. However, if an imaqe contains 
only a constant hue or if it contains a 
specific hue which is strong, then the 
density will have it^s greatest value at 
some level other than that of the Laplace 
density. 

The density of the other 
coefficients can be represented by a 
Laplace density with zero average value. 
The actual density may not be symmetric. 
The average value of the coefficient 
indicates the amount of skew. The 
majority of the coefficients have an 
average ,v;. ju-* clo se ho zero. The density 
plots of coefficient (1,?) in the Walsh 
domain for the SMPTE #1 and SMPTE #4 test 
slides are shown in fig. 9. 


Thus, linear quantization is 
suitable for coefficients (1,1), (16,R), 
and (16,9) and any other coefficient 
which require 7 or more bits. Nonuniform 
quantization with a Laplahe 
characteristic is suitable for all other 
coefficients which are to be transmitted. 

SIMULATION OP CODE C 

T,o simulate the codec a video 
image is first partitioned into data 
matrix and then each data matrix is 
transformed into a coefficient matrix 
usinq the Walsh transform. In order to 
obtain a good quality imaqe at the 
receiver and maintain as low a hit rate 
as possible, it is necessary to find 
which coefficients of each matrix ought 
to be transmitted and how many bits are 
sufficient to code these coefficients. 
Three types of filter are used as shown 
in fig. Id. 

On the average, FIL10 requires 
1.09 bits/sample, FIL15 requires 1.53 
bits/sample and F X L 1 ft requires 1 , ft 1 
bits/sample. Table 2 shows the amount of 
energy that is transmitted by each 
filter. Note that the values in Table 2 
do not take into consideration the 
quantization error. The number in these 
filters represent the number of bits 
required to code the corresponding 
coefficients. Coefficients requiring 7, 
8 or 9 bits are coded using a uniform 
quantizer with quantization spacing of 
0.5 if the largerst level allowed in the 
coefficient matrix is 256. Coefficients 
requiring less than 7 bits are coded 
using a nonuniform quantizer. 

The coefficients which represent 
the lower frequency components of an 
image are assigned a larqer number of 
bits because 1) they have larger energy 
and variance 2) the quantization noise in 
these coefficients are easily seen by 
human eyes, and 3) there are large 
changes in the averaae value of these 
coefficients from image to image so that 
a ncyniform quantizer is not suitable. 

The result of using these three 
filters are shown in fig. 11. The only 
degradation that is visiable when using 
FTLlfl is that there is a small amount of 
noise. 

The processed image with FILIP 
has stairwave contouring at slanted edqes 
and noticable resolution degradation. 
This is due to the fact that most of the 
coefficients which represent the details 
in an imaqe are suppressed. 

The processed image with FTLlt 
has substantial noise and tittle 
resolution degradation. The reason for 
this is that the coefficients are 
allocated a small number of bits a n ^ 
consequently the quantizer generates 
substantial amount of quantization noise. 
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In order to show that the 
coefficients { 1 6 , B ) and (16,9) nearly 
represent the 0 and I signals 
respectively* two other filters i.e. 
FIL.YQ and FILYI were used. These filters 
are the same as filter FIL18 except that 
coefficients (16,9), (16,lfl) and (15,9) 
are suppressed in FILYQ and coefficients 
(16, B), (16,7) and (15,8) are suppressed 
in FILYI. The image processed with FILYI 
is shown in fig. 12. In this case the 
color vectors are all on the I axis of 
the vectorscope as shown In fig. 13. All 
the color components in the processed 
image belong to two opposite hues. 


CONCLUSION 
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Fig.l VIDEO ACQUISITION SYSTEM 


We have shown that a NTSC 
c«mpo*lt*Y*ign*),'“can jbe decomposed -into 
its YTQ components by applyinq a 
two-dimensional Walsh transform to a 
properly sampled NTSC composite color 
signal. In addition, the YIQ components 
are always mapped into fix locations of 
the coefficient matrix in the Walsh 
domain. 

The advantage of this technique 
is that there is no loss of information 
that is normally associated with the use 
of comb filters in order to perform 
component coding of NTSC composite 
signals. The above results were extended 
to the PAL color system. 

’ Examples of component coding were 
presented which yield very good picture 
quality at 1.8 bits/pixel. At these 
rates two digital NTSC television signals 
can be transmitted over ?. single 36 MHz. 
satellite transponder using QPSK 
modulation!.’ 
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Fig. 2 Block diagram of codec for NTSC signals 
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(a) GMPTE H (b) COLON BARS 



Fig. 4 Phase relation of samples 
(a) subcarricr (b) mod. Q 
(c) mod. I (d) sampled Q 
(e) sampled I 
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Fig, 9 Level histogram of coefficient (1,2) 
(a) SMPTE#4 (b) SfJPTEdl 


Fig, 5 Locations of samples on 
color vector diagram 
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(18,8) 

(18,9) 

(1,1) 

white 

0.0 

0.0 

215 

yellow 

-21.7 

20.0 

168 

cyan 

-13.4 

-40. B 

14 B 

green 

-34.8 

-20.2 

136 

magneta 

35.2 

19.3 

117 

red 

13.9 

40.0 

104 

burst 

-17.3 

10.2 

60 

TABLE 1 Color bars coefficients 
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Fig. 7 Energy distribution of SHPTEJI1 


DIS 



Fig. 8 Level distribution of 
coefficient fl 3 3 


fiMPTEftl SMPTE04 

FILlfl 99.89 99.90 

FIL15 99.94 99.98 

FILlfl 99.94 99.98 

TABLE 2 Energy transmitted 
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Fig. 1C Three .'liters 

(a) riLIC 

(b) FIL15 

(c) FILIE 





Processed images: (a) original (b) FIL10 

(c) FI LI 5 <J) FI L 1 8 


( a ) orininal 
<b> FILV1 


ORIGINAL PAGE IS 
OF POOR QUALITY 


1 4|ft« s ’ 


M 

t: 1 

(i 

1 i» *■ * |»vy/ i 

BJ 


EV. 



^nrau i 

SSHto, ' ’» 















